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A  NEW  FOUNDATION  FOR  A  SIMPLIFIED 
PRIMAL  INTEGER  PROGRAMMING  ALGORITHM* 


Fred  Glover 


1 .  INTRODUCTION 


The  purpose  of  this  paper  is  to  show  that  the  conceptual  foundations  and 
presentation  of  R.  D.  Young's  Simplified  Primal  Integer  Programming  Algorithm  [8] 
can  be  simplified  further  on  the  basis  of  a  few  fundamental  algebraic  relations. 
These  relations  derive  from  the  approach  underlying  the  author's  Pseudo  Primal- 
Dual  Integer  Programming  Algorithm  [3]  which  contributed  to  the  basis  for  [8] 
and,  in  their  present  development,  provide  new  choice  rules  that  yield  a  finite 
primal  method.  In  addition,  a  criterion  of  optimality  is  introduced  that  gen¬ 
erally  permits  the  algorithm  to  be  terminated  before  the  customary  optimality 
conditions  are  manifested. 


2.  DESCRIPTION  OF  THE  PROBLEM 


We  represent  the  ordinary  linear  programming  problem  PI  as  that  of 


maximizing  in  nonnegative  variables 


x  =  a„  „ 

0  00 


+  £  aoj(_tj) 

j-1 


subject  to 


^  ^  a^j (— tj)  ,  i  =  1,  ...,  m  , 


j  —  -(— tj)  »  J  =  1 «  •••*  n  i 


The  author  is  deeply  indebted  to  Professor  Richard  D.  Young  for  many  stimulating 
discussions  that  have  contributed  to  the  development  of  this  paper. 
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or  in  matrix  form  to  maximize  xn  subject  to 


~  aOtO  aO 


X  =  AUT 


’  A  ”  (Ao’  A1  ’  *  * • ’  An^ 


The  matrix  A1  is  dual  feasible  if  aQ  >  0  for  j  =  1,  . ..,  n  ,  and 
primal  feasible  if  a^  Q  >  0  for  i  =  1,  ...,  m  +  n  .  As  is  well  known,  an  opti¬ 
mal  solution  to  Pi  is  immediately  given  by  X  =  AQ  when  both  primal  and  dual 
feasibility  hold. 

The  pure  integer  programming  problem  P2  ,  which  provides  the  chief  focus  of 
this  paper,  is  the  same  as  PI  except  that  the  components  of  X  are  additionally 
required  to  be  integers.  Following  the  lead  of  R.  D.  Young  [6,  7],  we  will  specify 
a  method  for  solving  P2  that  yields  a  nonnegative  (primal  feasible)  integer  X 
and  a  nondecreasing  value  of  xrj  at  each  stage  of  the  solution  process.  To 
provide  a  foundation  for  this  method,  we  review  the  version  of  the  simplex  al¬ 
gorithm  that  exhibits  the  same  characteristics  in  solving  PI  except  that  the 


successive  X  vectors  may  not  be  integer. 


The  value  of  such  an  approach  is  at  least  three  fold.  First,  it  is  possible  to 
begin  with  a  known  feasible  integer  solution  and  obtain  progressively  better  ones. 
Second,  one  may  discontinue  the  process  of  solving  P2  at  any  stage  and  still 
have  a  workable,  if  not  optimal,  solution.  Third,  the  method  typically  pro¬ 
vides  a  range  of  feasible  integer  solutions  instead  of  single  best  one,  which 
may  be  useful  in  certain  applications.  (These  features  may  of  course  be  of 
little  advantage  in  solving  problems  that  are  extremely  resistant  to  the  method, 
unless  such  problems  are  correspondingly  difficult  for  other  algorithms.) 


.  THE  PRIMAL  SIMPLEX  ALGORITHM  (PSA) 


Beginning  with  A°  primal  feasible,  the  primal  simplex  method  for  solving 
PI  determines  a  sequence  of  representations  for  X  : 

X  —  A^T^1  —  a*T*  =  a2T2  =  =  A^T^ 

mh/,  h  h  h.  ,  _  ,  , 

T  =  (1,  -t^  -t2,  -tn)  ,  h  =  0,  1,  k 

where  (j  ■  1,  n)  is  nonnegative,  a^Q  <  a^^  ,  and  A*1  is  primal  feasible 

for  each  h  .  When  PI  is  bounded  for  optimality,  the  matrix  A  (for  finite  k) 
is  also  dual  feasible. 

For  simplicity,  we  will  let  A  and  T  denote  any  matrix  A*1  and  vector 
,  and  let  A  and  T  denote  the  corresponding  A^+^  and  .  Then  the 

precise  rules  of  the  PSA  are  as  follows: 


1.  If  a„.  >  0  for  all  j  >  1  ,  then  X  =  A„  is  an  optimal  solution. 

Oj  *  =  0  r 

Otherwise,  select  s  >  1  such  that  a  <  0  . 

’  =  os 

2.  If  a.  <0  for  all  I  >  1  ,  PI  has  an  unbounded  optimum.  Otherwise, 

is  *  = 

compute  0  *  Min  (a,  /a,  )  . 

s  -  io  is 

a .  >0 
is 

4* 

3.  Select  v  such  that  a  >0  and  a  /a  =0 

vs  vo  vs  s 

4.  Determine  A  by  the  rules: 


A  *  -A  /a 
s  s  vs 


A  ■  A,  -  A  (a  /a  )  if  j  ^  s  . 
j  j  s  vj  vs  J 


5.  Let  t  =  x  and  t.  =  t.  for  i  i  s  .  Designate  A  and  T  to  be 
s  v  j  j 

the  current  A  matrix  and  T  vector,  and  return  to  instruction  1. 


We  do  not  concern  ourselves  with  tiebreaking  rules  in  the  choice  of  v  ,  since 
those  that  assure  finiteness  for  the  PSA  have  little  bearing  on  finiteness  for 
a  primal  integer  method. 
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Because  the  PSA  is  quite  effective  for  solving  PI  ,  it  is  natural  to  seek  an 
adaptation  of  this  algorithm  for  solving  P2  that  maintains  A  primal  feasible 
and  integer  at  each  stage.  The  first  step  toward  such  an  adaptation  (the 
Rudimentary  Primal  Algorithm)  is  straightforward,  and  has  apparently  been  redis¬ 
covered  on  several  occasions  (see,  e.g.,  [1,  5,  6]). 

4.  THE  RUDIMENTARY  PRIMAL  ALGORITHM  (RPA) 

Assume  that  the  constant  components  of  the  initial  A  matrix  are  integers 

and  the  t^  are  nonnegative  integer  variables. 

As  Ralph  Gomory  [4]  has  shown, equation  (1)  then  implies  the  cut^ 

n 

3  -ho/x!  +  £  kJ/x](-tJ)  •  (2) 

J-l 

where  \  0  and  s  is  a  nonnegative  integer  variable.  Thus  X  *=  AT  may  be 

augmented  to  include  (2)  without  altering  the  set  of  feasible  integer  solutions  to 
P2  .  Based  on  this,  the  RPA  occurs  by  replacing  instuction  3  of  the  PSA  with  the 
instruction  3A  below. 

3A.  Select  as  the  source  equation  for  (2)  any  equation  i  such  that 

a,  >0  and  0  <  a.  /a.  <  9  (e.g.,  the  equation  v  of  instruc¬ 
ts  *  l  io  isJ  =  s 

tion  3).  Let  A  =  ais  ,  and  designate  (2)  to  be  equation  v  of 
X  =  AT  . 

Designating  (2)  to  be  equation  v  is  simply  a  symbolic  device  to  specify  the 
transformation  of  A  into  A  by  instruction  4  of  the  PSA  (hence  of  the  RPA).  It 
is  unnecessary  to  augment  X  *  AT  by  (2)  if  one  is  interested  only  in  the  values 
of  the  original  variables  x^  . 


denotes  the  greatest  integer 


<  u  . 
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On  the  other  hand,  it  is  obvious  that  if  equation  (2)  as  determined  by  3A 
were  adjoined  to  X  =  AT  ,  then  it  would  qualify  to  be  selected  as  equation  v  in 
instruction  3  of  the  PSA.  Also,  the  coefficient  a^s  bequeathed  by  instruction  3A 
is  always  1  ([a^  /a^  J  )  •  These  facts  clearly  assure  that  the  successive  A 

matrices  determined  by  the  RPA  will  be  all  integer  and  primal  feasible.  Unfor¬ 
tunately,  however,  there  is  no  assurance  that  the  RPA  will  converge  to  an  optimal 
integer  solution. 

In  a  highly  original  paper  [6],  Richard  D.  Young  showed  how  the  RPA  could  be 
extended  by  the  addition  of  a  complex  set  of  rules  to  produce  a  finite  primal  in¬ 
teger  algorithm.  Subsequently,  drawing  on  certain  ideas  from  [3],  he  was  able  to 
develop  a  much  simpler  set  of  rules  whose  justification,  however,  remained  com¬ 
plicated.  Relying  still  more  heavily  on  [3],  we  now  introduce  an  alternate  frame¬ 
work  which  provides  the  simpler  rules  from  a  few  elementary  theorems,  and  in  ad¬ 
dition  provides  other  rules  that  lead  to  a  convergent  algorithm. 


5.  THE  SIMPLIFIED  PRIMAL  ALGORITHM 


To  produce  a  convergent  primal  integer  algorithm,  it  suffices  to 


(i)  adjoin  to  X  »  AT  an  additional  primal  feasible  and  all  integer 
equation  (call  it  r)  whose  coefficients  a^  satisfy  certain 
properties  in  relation  to  the  A^  , 

(ii)  select  s  in  instruction  1  of  the  RPA  by  reference  to  the  properties 
of  equation  r  , 


One  may  stop  and  restart  this  procedure  at  finite  intervals  in  the  execution  of 
the  RPA  if  the  number  of  digressions  is  finite.  This  can  be  assured  for  example 
by  reliance  on  an  intervening  criterion  of  progress,  such  as  an  uninterrupted  in¬ 
crease  in  the  sum  of  the  negative  a^  for  j  >  1  ,  or  in  the  value  of  aon 

(R.  D.  Young's  "transition  cycles"). 
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(iii)  periodically  select  the  source  equation  for  (2)  in  instruction  3A 

of  the  RPA  by  reference  to  the  size  of  the  coefficients  a.  (or 
y  is 

other  criteria  to  be  introduced  subsequently) . 


We  develop  the  properties  that  we  wish  equation  r  to  satisfy  (in  addition  to 
being  consistent  with  the  other  equations  of  X  *  AT  ) ,  while  simultaneously 
motivating  and  justifying  the  choice  of  s  according  to  (ii)  .  To  this  end,  we 
introduce  the  following  result: 

Lemma:^  Let  A.  *  A.  -  kA  for  some  scalar  k  .  Then  for  each  pair  of  indices 
-  j  j  s 

i  ,  r  : 


a  .a,  <  a  a. .  (>  a  a . .  ,  *  a  a, .) 

rj  is  rs  ij  rs  ij  rs  ij 


if  and  only  if 


a  .a.  <  a  a,.  (>  a  a.  ,  =  a  a.,) 

rj  is  rs  ij  rs  ij  rs  ij 


Proof :  By  definition. 


a  .a.  =  (a  ,  -  ka  )a.  =  a  .a.  -  ka  a. 

rj  is  rj  rs  is  rj  is  rs  is 


Also , 


a  a . .  »  a  (a . .  -  ka .  )  *  a  a.  -  ka  a , 
rs  ij  rs  ij  is  rs  ij  rs  is 


Thus 


a  .a.  -  a  a . .  =  a  .a.  -  a  a . , 

rj  is  rs  ij  rj  is  rs  ij 


This  proves  the  lemma. 


This  lemma  is  essentially  Lemma  2  of  (3). 
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Note  that  the  definition  of  in  the  foregoing  lemma  accords  with  the 

definition  of  for  j  ^  s  in  instruction  4  of  the  RPA.  Using  this  same 

definition,  we  now  extend  the  result  of  the  lemma  to  a  lexicographic  relation¬ 
ship^  between  vectors. 


Theorem  1: 


(HI)  a  A  <  a  A  (>  a  A.  ,  =  a  A  ) 
rj  s  rs  j  rs  j  rs  j 


if  and  only  if 


(H2)  a  A  <  a  A  (>  a  A  ,  =  a  A  ) 
rj  s  rs  j  rs  j  rs  j 


Proof:  Let  p  »  Min(i  :  a  .a.  +  a  a..)  and  q  =  Min(i  :  a  .a,  +  a  a,,)  . 

-  K  rj  is  is  lj  ^  rj  is  rs  ij 

By  the  lemma,  p  =  q  and  Theorem  1  follows  immediately. 


Theorem  1  gives  direct  access  to  the  properties  we  desire  the  reference 
equation  r  to  possess.  Indeed,  we  will  want  equation  r  to  be  created  so  that 
s  may  be  selected  to  satisfy  (HI)  of  Theorem  1.  The  power  of  Theorem  1  is  that 
it  implies,  for  s  so  selected,  that  equation  r  will  still  satisfy  the  same 
properties  relative  to  the  new  matrix  A  .  In  addition,  when  the  appropriate 
choice  rules  are  implemented,  the  theorem  assures  that  a  form  of  lexicographic 
progress  will  occur  in  passing  from  A  to  A  . 

To  make  the  foregoing  precise,  define 


A 


* 

j 


Aj  /a 


rj 


A  vector  A.  is  defined  to  be  lexicographically  smaller  than  a  vector  A, 

n  £  l  * 

(symbolized  A^  <  A^  or  A^  >  A^)  if  and  only  if  the  first  nonzero  component 
of  A^  -  A^  is  positive. 


8 


for  thos*a  j  >  1  such  that  a^  t  0  .  Then  we  specify  the  choice  of  s  in 
instruction  1  so  that: 

a  >0  and  A  <  A*  for  all  j^s(s,j>l)  such  that  a  >0  . 
rs  s  j  =  rj 


Note  that  if  there  exists  a  1  such  that  A.  <  0  and  a  .  >  0  ,  then  A 

J  j  rj  s 

exists  and  is  lexicographically  negative.  (There  is  clearly  no  need  to  consider 
the  possibility  A*  *  a£  for  j  ^  k  since  the  initial  A^  for  j  >  1  include 
the  -  I  matrix,  and  hence  begin  and  remain  linearly  independent.) 

The  properties  that  we  require  equation  r  to  satisfy  are  then  as  follows: 


t 


(PI)  A  ?  0  «>  a  >  0  , 

(P2)  a  <  0  «>  A*  $  A* 

rj  j  s 


It  may  be  observed  that  any  equation  with  all  positive  coefficients  will 
automatically  satisfy  both  (PI)  and  (P2)  .  In  particular  it  suffices  to  create 

equation  r  initially  with  a^  ■  1  for  all  j  >  1  and  a^  equal  to  an  upper 

v  it 

bound  for  )  t.  . 

L  J 

An  interesting  consequence  of  (PI)  is  that  if  aQs  >  0  (equivalently, 

a*  >0),  then  the  relation  A*  <  A*  for  a  >  0  implies  a..  >  0  for  all 
Os  -  s  j  rj  r  Oj  - 

j  >  1  ,  and  hence  A  is  dual  feasible.  But  a  <0  implies  that  any  change  in 

U  5 


tt 


These  properties,  as  developed  in  connection  with  the  Pseudo  Primal-Dual  In¬ 
teger  Programming  Algorithm,  are  approximately  equivalent  to  R.  D.  Young’s  sub¬ 
sequent  definition  of  an  "arranged  tableau"  in  [8].  Note  that  (P2)  *>  (PI) 

a 

if  there  exists  a  j  such  that  a  .  >  0  and  A,  <  0  . 

rj  j 

Under  the  assumption  that  P2  is  bounded,  any  all-integer  linear  form  £  arjtj 
can  be  maximized  by  the  simplex  method  subject  to  X  ■  AT  to  determine  an  upper 


bound  a 


rO 


It  is  implied  by  our  results  to  follow  that  if  the  a  satisfy 


(PI)  and  (P2)  ,  and  if  a  <  1  ,  then 
solution  to  (P2)  . 


X  «  A  already  provides  an  optimal 
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Aq  must  produce  an  (integer)  increase  in  aQQ  .  Thus,  in  a  bounded  problem, 
the  number  of  changes  in  must  be  finite  whether  the  algorithm  itself  is 

finite  or  not.  Our  next  theorem  summarizes  the  joint  implications  of  Theorem  1 
and  the  properties  (PI)  and  (P2)  we  have  required  of  equation  r  . 


Theorem 

_2!+ 

If  (PI) 

and  (P2) 

are  satisfied 

for  the  matrix 

A  ,  then 

(HI) 

of 

Theorem  1 

is  true, 

and 

(PI) 

and 

(P2) 

are  also 

satisfied 

for  A 

• 

Moreover, 

A*  £  A* 

J  s 

for 

all  j 

such 

that 

a  .  >  0 
rj 

(in  particular, 

7*  Z  .  * 

A-  >  A  , 
s  s 

where  s 

is 

defined 

relative 

to  A  as 

s  is  to 

A). 

Proof : 

The 

definition 

of  Ag  directly  implies 

(HI) 

for  those  j  ^  s 

such  that 

3rj 

>  0  ,  and 

(P2)  implies 

(HI) 

for 

those 

j  such 

that  a  , 

rj 

<  0  . 

If 

arj 

-  0  ,  (PI) 

follows 

from 

(PI) 

and 

the  fact  that 

A.  4  0  for  all 

J 

j 

Thus,  (H2)  is  true  by  Theorem  1  and  A.  <  0  =>  a  .  >  0  .  Hence  (PI)  is 

J  rJ 

satisfied  for  A  .  Also,  dividing  (H2)  through  by  a  a  gives 

rj  rs 

A*  >  A*  when  a  .  >  0  and  A*  >  A*  when  a  .  <  0  ,  j  ^  s  .  The  former 

j  s  rj  s  j  rj 

proves  the  last  assertion  of  the  theorem,  and  the  latter  in  conjunction 

with  A-  >  A*  proves  ( P 2 )  holds  in  A  if  j  ^  s  .  But  (P2)  also 

s  s 

•  JL 

holds  if  j  =  s  since  Ag  =  Ag  .  This  completes  the  proof. 

Having  now  established  the  form  of  equation  r  and  the  definition  of  the 
index  s  ,  it  remains  to  specify  the  choice  of  the  source  equation  for  equation 
(2)  in  instruction  3A.  The  following  result,  in  conjunction  with  Theorem  2,  lays 
the  foundation  for  this  choice. 


•j* 

Theorem  2,  from  results  of  [3),  has  a  close  resemblance  to  some  of  the  results 
of  Young’s  original  primal  algorithm  [6],  and  very  probably  is  collectively 
implied  by  them  under  appropriate  reformulation. 
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Theorem  3: 


t 


If  X  =  a  >0  and  equation  (2)  is  designated  to  be  equation  v 

1  b 

instruction  4  of  the  RPA,  then 


in 


a.  =  -a.  and 
is  is 


a.  >  a. .  >  0  for  j  ^  s  . 
is  ij  = 


Proof:  Since  a  =  1  ,  a.  =  -a.  .  Also,  for  i  ^  s  .  a..  =  a., 

-  vs  ’is  is  ’  J  *  ij  ij 

The  theorem  follows  at  once  from  the  fact  that  u  >  [u]  >  u 
u  . 


fa,, /a.  ]a. 

L  ij  isJ  is 

1  for  all 


Note  that  if  a^g  >  ,  then  Theorem  3  implies  that  one  may  repeatedly  select 

equation  i  as  source  equation  for  (2)  in  instruction  3A  and  thereby  eventually 

assure  a.  <  a . „  ,  unless,  of  course,  A  becomes  dual  feasible  in  the  interim, 
is  =  iO 

By  reference  to  this  fact,  R.  D.  Young  then  gives  the  following  prescription  for 
the  selection  of  the  source  equation:  use  any  rule  that  assures,  for  each  i  >  1 
(including  i  =  r) ,  aig  <  a^  will  occur  at  finite  intervals.  Theorem  3  provides  a 
ready  mechanism  for  implementing  this  prescription,  as  indicated  by  our  foregoing 
remarks. 

We  will  here  give  some  alternate  choice  rules  that  also  produce  a  convergent 
primal  algorithm  and  are  easily  justified  within  the  framework  of  our  present  develop- 
ment.  The  first  rule  is  slightly  more  flexible  then  the  one  given  above. 


Theorem  3  was  first  introduced  in  the  context  of  a  primal  algorithm  by  Young  in 
[6],  and  in  the  context  of  a  dual  algorithm  at  about  the  same  time  by  the  author 
in  [2]. 

*  Since  a  /a  *  0  ,  equation  i  is  a  permissible  source  equation  in  instruction 
3A.  w 

^  It  is,  however,  close  in  spirit  to  Young's  justification  of  his  rule. 


11 


Rule  1:  Make  any  choice  that  assures  a  <  a  at  finite  intervals,  and 
-  rs  =  ro 

periodically  reduces  a*g  for  the  least  i  >  1  such  that 

* 

a.  >  a. 
is  io 


We  note  that,  since  a  >1  (by  (PI)),  it  follows  that  a.  >  a.  for 

*  g  =  J  '  *  ics  i  o 


is  =  is 


a  >  0  ,  and  hence  (a*  >  a.) ->  (a.  >  a. (equivalently, (a.  <  a.  )=>(a*  <  a,  ))  . 

is  «  *  'is  i7  '  is  iO7  M  7  '  is  =  io7  '  is  =  io'7 

Consequently,  Rule  1  is  meaningful  and  can  be  implemented  by  repeatedly  selecting 
equation  i  as  the  source  equation  until  a*g  is  decreased,  unless  A  becomes 
dual  feasible  and  the  algorithm  terminates  first.  We  prove  that  this  rule  provides 
a  finite  algorithm  as  follows. 


Justification  of  Rule  1:  As  observed  earlier,  Aq  can  be  changed  only  a 

finite  number  of  times.  Hence,  for  each  i  ,  there  exists  a  finite 

constant  U,  such  that  a. „  <  U,  for  all  values  assumed  by  a . 

i  10  *  i  io 

Assume  that  Rule  1  is  not  finite.  Then  there  is  an  infinite  set  T 

of  A  matrices  in  which  a  <  a  <  U  Since  A  is  lexico- 

rs  =  ro  =  r  s 

graphically  strictly  increasing  and  aQg  <  0  it  follows  that  a*g 
can  only  assume  a  finite  number  of  values  in  T  and  hence  must 
eventually  become  constant  (both  in  T  and  outside  of  T) .  Applying 
this  argument  to  successive  components  of  A*  ,  at  least  one  of  which 
must  be  unbounded,  there  exists  an  index  q  >  1  such  that  for  all 
A  matrices  after  an  initial  finite  number  (call  the  infinite  re¬ 
maining  set  of  matrices  S),  a*  >  U  >  a  „  and  a*  is  nondecreasing 

qs  q  =  qO  is 

•ff 

for  all  i  <  q  .  But  at  some  point  in  S  ,  Rule  1  will  reduce  a^g 

for  some  i  <  q  such  that  a*  >  a,  ,  which  is  impossible.  This 
=  1  is  io 

4- 

completes  the  justification. 


+ 


It 


U 

r 


is  clear  from  this  proof  that  af  i  and  a^(i  may  alternately  be  replaced  by 
and  in  the  specification  of  Rule  1.  Also,  it  is  unnecessary  to  require 

to  be  decreased  unless  it  has  been  nondecreasing  for  some  finite  duration. 
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The  second  rule  we  give  has  a  somewhat  different  character  than  the  first, 

drawing  on  additional  results  underlying  the  Pseudo  Primal-Dual  Algorithm.  The 

Pseudo  Primal-Dual  Algorithm  extablishes  dual  feasibility^  by  a  strict  increase  in 

the  first  nonzero  component  of  A  at  each  step,  thus  providing  a  more  evident 

s 

push  toward  convergence  than  the  successive  lexicographic  increases  in  A*  .  In 

s 

the  interest  of  achieving  comparable  advances  toward  convergence  with  a  primal 
algorithm,  one  is  tempted  to  select  a  source  equation  whenever  possible  that  will 
result  in  a  -  '  an  .  The  somewhat  surprising  fact  is  that  such  a  choice  will 
indeed  produce  a  finite  algorithm,  as  we  now  show. 


Rule  2;  At  finite  intervals:  select  as  source  equation  (if  possible)  one 

that  will  result  in  a  -  >  a  ,  and  continue  the  selection  of  source 

Os  os 

equations  by  this  criterion  until  there  are  none  that  satisfy  it. 

t  + 

As  a  basis  for  establishing  the  validity  of  this  rule,  we  introduce  - 


Theorem  4:  For  A  and  A  satisfying  conditions  (PI)  and  (P2)  ,  and 


a 


Os 


<  0  : 


a  ) 
rs 


(ioi 


Proof:  By  Theorem  2,  (HI)  is  satisfied,  hence  by  Theorem  1 


a  a  -  <  a  a  -  .  Since  a 
os  rs  *  rs  Os  Os 

a  -/an  <  a  -/a  <  1  ,  hence 

Os  Os  «  rs  rs 


<  0  and  a  >  0 
rs 


we  have 


A  dual  feasible  matrix  is  driven  dual  infeasible  in  such  a  way  that  equation  r 
occurs  naturally  in  X  =  AT  .  Then  dual  feasibility  is  restored  by  continued 
selection  of  equation  r  as  the  source  equation,  and  the  net  progress  in  AQ 
between  two  consecutive  instances  of  dual  feasibility  is  at  least  as 
great  as  that  produced  by  pivoting  with  the  dual  simplex  method. 

ft  _ 

This  result  abstracts  a  portion  of  Theorem  2  of  [3].  Part  of  the  remainder  of 
the  theorem  is  developed  in  the  justification  for  Rule  2. 
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The  completed  proof  that  Rule  2  yields  a  finite  primal  algorithm  is  as 
follows : 

Justification  of  Rule  2:  Assume  that  the  rule  is  not  finite.  By  Theorem  3, 

if  equation  r  is  selected  as  the  source  equation,  then  a^-  <  arg 

and  hence  by  Theorem  4  a  -  >  a„  .  Thus,  Rule  2  assures 
J  Os  Os 

a  <  a  foran  infinite  number  of  A  matrices.  Identify  q  and 
rs  •  rO 

S  as  in  the  justification  for  Rule  1.  If  q  were  selected  as 

source  equation  in  S  (it  is  always  eligible),  we  have  a  -  <  a 

qs  qs 

(by  Theorem  3),  and  this  in  conjunction  with  a*-  >  a*g  implies 

a  >  a  -  .  Then  by  Theorem  4,  for  every  A  matrix  in  S  there 

is  a  source  equation  available  (namely  q)  that  will  yield 

a  -  >  a„  .  Rule  2  will  thus  produce  an  infinite  number  of  con- 
Os  os  * 

secutive  integer  increases  in  a&g  ,  which  is  impossible. + 

Until  now  we  have  assumed  that  the  algorithm  terminates  only  when  A  becomes 
dual  feasible.  A  basis  for  eliminating  this  assumption,  and  hence  for  increasing 
the  effectiveness  of  the  choice  rules,  is  embodied  in  the  following  theorem. 


It  may  be  noted  that  Rule  2  remains  valid  by  this  proof  when  the  condition 

a  -  <  a  replaces  a  -  >  a  .An  argument  mirroring  the  proof  of  Theorem  4 
IT  8  rs  vJ  s  Os 

also  shows  that  selecting  equation  i  as  source  equation  will  result  in 

a  -  <  a  whenever  a.-  *  >  a.  *  .  Other  rules  closely  related  (but  not  e- 

rs  rs  is  »  is 

quivalent)  to  the  foregoing  ones  can  immediately  be  inferred  from  this:  e.g., 
enforce  arg  <  arQ  at  finite  intervals  and  periodically  select  any  source  e- 

quation  i  such  that  ais*  ?  ai&  anc*  a^-*  «  als*  *  contlnu^n8  the  selection  of 

i  by  this  criterion  as  long  as  possible. 

This  theorem  can  alternately  be  justified  by  the  observation  by  R.  D.  Young  that 
an  appropriate  multiple  of  row  r  provides  a  feasible  solution  to  the  dual  of 
PI  (defined  for  the  current  A  matrix).  In  this  connection,  Ben-Israel  and 
Charnes  [1]  anticipate  the  present  use  of  this  result  by  advocating  the  solution 
of  an  auxiliary  problem  to  prescribe  termination  before  A  is  dual  feasible. 


Theorem 


Proof : 
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5 :  Assume  that  A  is  dual  infeasible  and  satisfies  (PI)  and  (P2)  . 

Then  the  optimal  value  of  x  must  satisfy 

0  J 


x 


0 


a  + 

00 


Let 
Cw  ’ 


P2'  be  the  problem  obtained  from  P2  by  introducing  a  new  variable 
and  replacing  each  equation  oi  P2  by 
n 


io 


j-1 


i=0,  1,  . . . ,  m  +  n  +  1  , 


(where,  e.g.,  r  =  m  +  n  +  1)  ,  and  adjoining  the  two  additional  equations 


x  , 0  =  - (-t  ) 
m+n+2  w 


Xm+n+3  Cw 


These  last  equations  assure  that  every  optimal  solution  P2’  is  also  op¬ 


timal  for  P2  ,  disregarding  t  ,  x  ,  and  x  ,  ,  „  (which  must  all 

w  m+n+2  m+n+3 

equal  0).  Let  a,  =  -a.  /a  for  i  =  0,  1,  . ...  m  +  n  +  1  .  Then 
iw  is  os  ’ 

clearly  w  satisfies  the  requirements  for  s  in  P2'  .  Suppose  equation 


r  is  selected  as  the  source  equation  in  P2'  ,  with  a  taking  the 

a  c 

place  of  a  (whether  or  not  -  <  9  )  . 

rs  a  =  w 

rw 

It  follows  from  Theorems  3  and  4  that  a  -  >  a  ,  where  w  denotes 

0w  0w 

the  index  that  corresponds  to  s  in  P2'  .  But  a  =  -1  ,  hence 

0w 

a  -  =  0  (it  must  be  an  integer)  and  A  is  dual  feasible  in  P2'  (though 


possibly  not  primal  feasible).  Consequently,  aR0  (in  P2')  provides  an 

upper  bound  for  x  .  But  from  instruction  4  of  the  RPA,  with  w  re- 

0 

placing  s  ,  we  have  a„„  =  aA„  +  f-a  a*  J  ,  since  a  *  -1  and 

00  00  L  ro  0S-*  *  0W 
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a 

rw 


a 

rs 


1 


t 


It  is  immediate  from  Theorem  5  that  X  =  Aq  provides  optimal  solution  to 


P2  whenever  a*  > - .  This  fact  not  only  permits  earlier  termination  of 

Os  a 

ro 

the  algorithm,  but  also  gives  rise  to  an  additional  choice  rule. 


Suppose  that  X  *  AT  is  augmented  by  the  equation 


n 

x  *  a  +7  a  .  (-t . ) 
u  uo  /  -j  uj  j 

j  =  l 


where  a  ,  -  -a  ,  for  1  >  1  and  -a  is  a  nonpositive  lower  bound  for 
uj  oj  J  -  uo  F 

)a  .t,  .  Then  we  have 

L  OJ  J 


Rule  3:  Replace  a  <  a  by  a  <  a  in  Rule  1.  and  terminate  when 
-  r  rs  *  ro  us  *  uo 

a*  >  — ■ —  (if  A  is  not  dual  feasible). 
os  a 


Justification  for  Rule  3;  The  justification  is  the  same  as  for  Rule  1  if 

a  <  C  occurs  periodically  for  some  finite  constant  C  .  Other- 
rs  * 

wise,  if  the  algorithm  doesn't  converge,  a  >  U  •  U  >  a  a 

rs  u  r  =  uo  ro 

for  all  A  matrices  except  an  initial  finite  number.  In  some  of 


of  the  subsequent  matrices  a  >  a  =  -a  and  hence 

U  =  US  os 

a*  > - —  ,  contrary  to  the  nonconvergence  assumption, 

08  ar0 


More  generally  in  defining  P2'  let  a  =  -ka  /a  for  k  >  0  .  Then  selec- 

1 w  is  Os 

ting  r  as  a  source  equation  yields  a^  =  +  kfo^/k]  for  j  =  0,  1,  ...,  n 

where  p,  ■  -a  ,a*  .  Thus  a  more  restrictive  upper  bouid  on  x  is  obtained 

J  rj  Os  ^  0 

by  selecting  k  >  0  to  minimize  aQ0  +  k[pn/k]  subject  to  k[p4/k]  >  a 


0' 


j  J  =  Oj 


ft 


(to  assure  a.>0),j=0,  1,  ...  ,n.  Note  that  a  /k  must  be  an  integer 
Oj  *  Os  6 

to  satisfy  this  latter  inequality  for  j  =  s  . 

Since  a*  is  nondecreasing,  a  <  a  n  implies  a  <  a  .  for  an  appropriately 

Os  rs  =  rO  K  rs  =  u0  rr  r  j 

large  value  of  a^^  ,  and  hence  Rule  3  includes  Rule  1  as  a  special  instance. 
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